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LONG-TERM  GOALS 

The  primary  research  goal  is  to  develop  techniques  to  determine  subsurface  turbulence  from  remote 
measurements  using  infrared  imaging  of  the  skin  layer.  We  aim  to  infer  flow  rate,  turbulence  intensity 
and  subsurface-generated  turbulent  structures  from  surface  temperature  patterns.  We  will  take 
advantage  of  the  two  complementary  indicators  of  subsurface  flow  provided  by  IR  imagery:  the 
thermal  structures  measured  directly  and  the  surface  velocity  fields  obtained  through  various  image 
processing  techniques.  We  will  (1)  analyze  the  variability  and  structures  of  the  thermal  boundary  layer, 
(2)  compute  the  surface  flow  field  from  the  IR  imagery  and  infer  further  surface  turbulence 
characteristics,  (3)  determine  to  which  extent  the  turbulence  in  the  boundary  layer  is  due  to  surface 
forcing  by  analysis  of  the  air-sea  flux  data  and  (4)  determine  empirical  relationships  of  subsurface  flow 
characteristics  and  of  turbulence  derived  from  in  situ  sub-surface  data  to  the  observed  turbulence  in  the 
IR  imagery.  We  further  aim  to  determine  the  limits  of  remotely  inferring  flow  rates,  subsurface 
turbulence  and  bed  stress  from  IR  imagery.  We  will  investigate  how  different  wind,  tides  and  wave 
breaking  conditions  affect  our  ability  to  remotely  measure  subsurface  flow  characteristics. 

OBJECTIVES 

The  skin  temperature  is  governed  by  surface  and  subsurface  processes.  Net  air-water  heat  flux  leads  to 
a  cooler  thermal  boundary  layer  (TBL)  compared  to  the  underlying  bulk  layer.  Turbulent  motions 
resulting  from  wind  forcing  at  the  air-sea  interface  and  from  turbulent  eddies  generated  within  the 
water  column,  disrupt  the  TBL,  mixing  it  with  the  bulk  layer.  During  the  last  century  links  between  air- 
water  transfer  and  bulk  turbulence  were  researched  ( Brumley  and  Jirka,  1988;  Danckwerts,  1951). 

Only  in  the  last  decade,  has  the  TBL  been  recognized  as  the  intermediate  step  between  subsurface 
turbulence  and  air-water  transfer  and  as  such  was  used  as  a  more  direct  indicator  for  air-water  transfer 
( McKenna  and  McGillis ,  2004).  This  study  will  use  the  TBL  as  a  direct  indicator  for  subsurface 
turbulence  and  provide  predictive  relationships  of  the  surface-bulk  connection.  It  will  result  in  a  be  a 
set  of  universal  curves  connecting  remotely  collected  surface  measurements  to  fundamental  local  flow 
quantities  -  the  flow  depth,  the  bed  stress,  the  bulk  mean  flow  and  the  bulk  turbulent  kinetic  energy. 
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APPROACH 


Building  on  our  extensive  expertise  in  IR  imagery  and  our  experience  in  making  near-boundary 
turbulence  measurements,  we  aim  to  determine  empirical  relationships  between  surface  length-scales 
and  flow  and  sub-surface  flow  and  turbulence.  During  the  prototype  field  campaign,  data  was  collected 
with  the  following  instruments: 

•  IR  camera:  a  Cedip  Jade  III  longwave  camera  was  mounted  a  pan/tilt  system  from  the  A-frame 
of  a  moored  ship.  This  set  up  allowed  us  to  move  the  camera  with  the  current  so  to  always  view 
upstream  of  the  ship.  The  Cedip  Jade  III  offers  better  than  15  mK  temperature  resolution,  with 
200  Hz  max  frame  rate,  14-bit  digitization,  and  320  x  240  pixels.  The  sampling  frequency  was 
set  to  60  Hz. 

•  Air- Sea  Flux  package:  a  meteorological  station  was  mounted  on  a  piling  neighbouring  the  ship 
to  get  measurements  of  wind  speed  &  direction,  relatively  humidity,  atmospheric  pressure,  air 
temperature,  solar  insolation,  and  longwave  radiation. 

•  Acoustic  Doppler  Velocimeter  (ADV):  a  Nortek  Vector  type  ADV  was  mounted  on  the 
aforementioned  piling  at  1  lm  above  the  River  bed.  Data  was  collected  in  10  min  bursts  at  top 
of  every  A  hr,  with  a  sampling  frequency  32Hz. 

•  Higher  Resolution  Profilers:  2  Nortek  Aquadopp  were  mounted  on  the  piling  at  3  and  6  m 
above  the  river  bed.  They  offer  a  1-cm  resolution.  Data  was  collected  in  59.9  min  burst  at  top 
of  every  hour,  with  a  sampling  frequency  2  Hz. 

•  CTDs:  3  CTDs  were  mounted  on  the  piling  at  the  same  levels  as  the  ADV  and  Aquadopps 


The  team’s  envisaged  data  analysis  effort  includes:  image  processing  and  analysis  of  the  IR  imagery  to 
characterize  surface  turbulence.  This  comprises  calculation  of  the  statistical  moments,  histograms  to 
assess  surface  skin  temperature  variability,  and  determination  of  length  scales  of  the  skin  temperature 
structures.  Further  3  methods  to  determine  the  surface  velocity  field  from  the  IR  imagery  will  allow 
inferring  integral  length  scales,  as  well  as  the  surface  turbulent  kinetic  energy  and  calculation  of 
divergence.  The  bulk  Reynolds  number  can  then  be  determined  from  the  divergence.  Analysis  of  the 
Aquadopps,  ADV  and  CTD  data  combined  will  provide  a  robust  measure  of  subsurface  turbulent, 
convective,  and  advective  motions.  Links  between  the  subsurface  and  surface  turbulence  will  be 
investigated,  keeping  in  mind  that  the  observed  turbulence  at  the  surface  is  partly  due  to  surface 
forcing.  Processing  and  analysis  of  the  direct  measurement  of  heat,  mass  and  momentum  fluxes  across 
the  air-water  interface  along  with  measurements  of  the  radiative  forcing  will  permit  to  separate  the 
different  processes  (wind-driven,  bed-driven,  buoyancy-driven,  and  convective)  which  lead  to  surface 
turbulence. 

WORK  COMPLETED 

Our  efforts  in  FY 1 1  comprised  image  processing  and  analysis  of  the  IR  imagery  taken  from  the  ship  so 
to  determining  the  temperature  variability  and  scales  of  observed  patterns.  Further  the  3  methods  to 
determine  the  surface  flow  were  applied  and  compared  to  one  another  as  well  as  to  in-situ  ADV  data. 
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RESULTS 


The  field  campaign  was  undertaken  in  the  Hudson  River  on  the  nights  of  November  18th  and  19th 
2010.  The  study  area,  shown  in  Figure  1  (left),  20  miles  north  of  Manhattan,  is  located  by  the  State 
Line  Lookout  in  the  Palisades  Interstate  Park,  NJ.  A  series  of  10  minute  surface  IR  measurements  were 
taken  simultaneously  from  the  top  of  the  State  Line  Lookout  cliff  (camera  deployed  by  Dugan’s  team) 
and  from  a  boat.  Throughout  the  campaign,  the  boat  was  moored  within  the  field  of  view  of  the  cliff 
top  camera.  IR  data  were  collected  every  30  minutes  between  0100-0600  UTC  on  the  18th  (yearday 
322)  and  between  0400-1000  UTC  on  the  19th  (yearday  323)  amounting  to  a  total  of  23  runs.  Surface 
and  subsurface  in  situ  instruments  mounted  on  a  piling,  as  shown  in  Figure  1  (right),  provided 
measurements  of  environmental  parameters  such  as  wind  speed,  heat  fluxes,  air  and  water 
temperatures,  humidity  as  well  as  subsurface  currents,  turbulence  and  salinity. 


Figure  1.  The  left  panel  shows  a  Google  Earth  satellite  image  of  the  study  area.  The  red  polygon 
represents  the  field  of  view  the  IR  camera  mounted  on  the  Cliff  of  the  State  line  Lookout,  within 
which  the  boat  and  the  instrument  piling  where  located.  The  right  panel  shows  a  schematic  of  the  in 

situ  instruments  deployed 
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Environmental  conditions 


yearday  2010 

Figure  2.  Time  series  of  the  30  minute  averaged  horizontal  wind  magnitude  measured  by  the 
meteorological  station,  the  red  dots  represents  the  IR  data  collection  periods 


During  the  prototype  field  campaign  IR  measurements  were  taken  under  varying  wind  conditions  as 
shown  in  Figure  2.  The  wind  was  stronger  on  the  night  of  the  18th  (yearday  322)  than  on  the  night  of 
the  19th  (yearday  323).  The  30  minute  maximum  wind  speed  ranged  from  0.12  m  s'1  to  3.62  m  s'1. 

Time  series  of  the  net,  the  sensible  and  the  latent  heat  flux  as  well  as  of  the  long  and  shortwave 
radiation  and  momentum  flux  (stress)  for  every  30  minutes  are  shown  in  Figure  3.  The  net  heat  flux 
(Qnet)  on  the  night  of  the  18th  was  of  -139.95  ±23.21  W/m2,  whereas  on  the  night  of  the  19th  it  was  of 
-145.43  ±  63.78  W/m2.  As  the  field  campaign  took  place  during  the  night-time,  the  shortwave  radiation 
was  equally  small  during  both  nights.  The  net  longwave  radiation  which  includes  the  downward 
longwaves  measured  by  the  meteorological  station  and  the  upward  longwave  radiation  from  the  sea 
surface  (~  soSST4)  was  of  -81.46  ±  25.88  W/m2  on  the  first  night  and  -89  ±31.67  W/m2  on  the  second 
night.  The  sensible  heat  flux  was  mostly  positive  on  the  18th  (±10.52  ±  12.04  W/m2),  but  negative  on 
the  19th  (-12.89  ±  14.88  W/m2)  and  a  generally  stronger  latent  heat  flux  was  recorded  on  18th  -66.65  ± 
22.07  W/m2  compared  to  -41.16±34.68  W/m2  19th.  The  momentum  flux  was  much  stronger  on  the  18th 
with  a  mean  and  standard  deviation  of  0.30  ±  0.23  kg/m  s2;  on  the  19th  it  only  reached  0.125  ±  0.08 
kg/m  s2. 
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Figure  3.  Time  series  of  the  shortwave  and  net  longwave  radiation,  the  latent,  sensible  and  net  heat 
fluxes  as  well  as  of  the  momentum  flux  (stress)  measured  by  the  meteorological  station.  The  shading 

represents  the  IR  data  collection  periods 


Skin  temperature  variability 

The  IR  imagery  shows  high  variability  in  small-scale  structures.  Figures  4-7  show  examples  of  the 
different  patterns  observed,  which  range  from  along-wind  elongated  streaks  to  more  rounded  boils. 
Breaking  is  clearly  visible  under  the  high  wind  conditions  that  prevailed  during  the  night  of  the  1 8th  as 
can  be  seen  in  Figure  4  &  5.  Elongated  streaks  are  mostly  present  under  stronger  winds,  when  no 
waves  and  breakers  are  present  as  exemplified  in  Figure  6.  Whereas  under  very  low  wind  conditions, 
we  mostly  observed  broils  and  more  sinuous  streaks  as  seen  in  Figure  7. 
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Run  01  Frame  2 


Run  01  Frame  22 


Figure  4.  Breakers  and  temperature  structures  under  high  wind  conditions  during  run 

1  on  the  18th  (\ U\~l.  7m/s) 


Under  strong  winds,  reflections  overlay  the  temperature  signature  in  the  IR  imagery,  such  as  in  Figure 
5.  These  are  not  easily  detectable  on  still  images,  but  when  a  sequence  of  images  is  displayed  as  a 
movie,  one  can  easily  detect  the  skin  temperature  underlying  the  reflection  which  appears  as  a  semi¬ 
transparent  film.  We  are  working  on  developing  a  robust  method  to  filter  out  the  reflective  signal. 
More  to  the  proposed  method  will  be  found  in  the  last  section. 
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Figure  5.  Waves  passing  through  during  run  3  on  the  18  (\U\~2. 9  m/s), 


Run  1 1  Frame  30 


Run  11  Frame  15340 


Figure  6.  Skin  temperature  structures  under  calmer  wind  conditions  during  run  11  on  the  18' 

(\U\~2.36  m/s). 


Run  12  Frame  10  Run  12  Frame  2964  Run  12  Frame  20796 


50  100  150  200  250  300  50  100  150  200  250  300  50  100  150  200  250  300 


Figure  7.  Skin  temperature  structures  under  calmer  wind  conditions  during  run  12,  the 

first  run  on  the  19th. 


Figure  8  below  illustrates  the  different  types  of  temperature  distributions  observed  during  each  run. 
Each  histogram  corresponds  to  the  skin  temperature  of  a  whole  run,  i.e.  over  10  min.  Most  runs  have  a 
distribution  resembling  that  suggested  by  Garhe  et  al.  [2003]  as  exemplified  by  the  histogram  of  run 
03.  However,  there  are  also  distributions  skewed  the  opposite  way  and  Gaussian-looking  histograms  as 
for  runOl  and  runl  1  respectively.  Run  12  displays  a  clearly  bimodal  histogram.  The  different 
distributions  arise  from  the  fact  that  over  10  minutes  the  skin  temperature  varies  quite  substantially  and 
that  hence  looking  at  run  means  does  not  provide  an  adequate  way  to  characterize  the  distribution  of 
the  skin  temperature.  Indeed,  as  shown  in  Figure  9,  the  frame  mean  temperature  is  not  constant  over 
the  duration  of  a  run.  It  can  vary  by  0.3  °C  or  more. 


run  01 


run  03 


Figure  8.  Histograms  of  the  skin  temperature  distribution  over  10  minutes  for  run  01,  03, 11  and  12. 
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However,  high  variability  may  also  be  observed  within  an  individual  frame.  The  right  panel  of  Figure  9 
shows  time  series  of  the  standard  deviation  of  the  skin  temperature  per  per  frame.  It  is  clearly  visible 
that  the  standard  deviations  are  higher  for  run  12  than  for  the  other  runs.  This  suggests  that  the  bimodal 
distribution  seen  in  Figure  8,  may  be  due  to  bimodal  variability  within  a  frame  rather  than  over  the  run. 
Computing  a  histogram  for  each  frame  and  plotting  them  as  a  2D  time  series  as  shown  in  Figure  10, 
lifts  the  doubt  as  bimodal  distributions  are  clearly  visible  for  most  frames  of  runl2,  unlike  for  the  other 
runs. 

Run  12  was  recorded  under  the  calmest  wind  conditions  compared  to  runs  1,  3  and  11.  The  high 
observed  spatial  skin  temperature  variability  can  be  explained  by  the  fact  that  the  weaker  wind  less 
effectively  mixes  the  surface,  mixing  water  up  at  a  lower  rate.  Stronger  winds  generate  more  mixing 
and  can  hence  lead  to  a  more  uniform  skin  temperature  distribution. 
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Figure  9.  Timeseries  of  the  frame  mean  temperature  (left)  and  standard  deviation  (right)  for  runs 

01,  03, 11  and  12. 
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Figure  10.  Time  series  of  frame  skin  temperature  histograms  for  runs  01,  03, 11  and  12. 


Scale  analysis  of  Skin  Temperature 

Calculating  the  normalized  autocorrelation  function  for  each  row  and  column  of  a  frame  and  then 
averaging  over  the  rows  and  column  to  get  frame  mean  normalized  autocorrelation  function  allows 
inferring  the  length  scale,  in  the  x  and  y  direction,  of  the  surface  skin  patterns.  The  length  scale  is  taken 
as  the  lag  at  which  the  normalized  autocorrelation  function  goes  to  zero. 

Figure  11a  shows  an  example  of  a  time  series  of  frame  mean  normalized  autocorrelation  function  from 
which  the  integral  length  scales  are  calculated.  The  integral  length  scales  vary  quite  substantially  over 
the  length  of  a  run  as  can  be  seen  in  Figure  1  lb.  As  expected  the  calculated  length  scales  are  more  an¬ 
isotropic  under  high  wind  conditions.  The  integral  length  scales  calculated  vary  between  30.30  ±  12.53 
pixels  and  70.02  ±  26.75  pixels,  with  1  pixel  approximately  equal  to  1cm.  Our  ongoing  analysis 
includes  linking  the  length  scales  and  associated  viabilities  to  measured  surface  forcing  and  sub¬ 
surface  turbulence. 
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Figure  11-Time  series  showing  an  example  of  (left)  the  normalized  auto  correlation  function  in  the 
y  direction  relative  to  the  image,  (right)  of  the  calculated  integral  length  scales  in  the  x  and  y 

direction  for  run  12. 


Surface  Flow  from  IR  imagery 

Surface  velocity  fields  have  been  determined  by  3  approaches: 

•  Feature  tracking  or  PIV 

•  Optical  flow  (OF) 

•  From  advective  surface  in  3D  spectra  of  the  skin  temperature  (SAS) 

The  feature  tracking  PIV  method  is  based  on  2D  spatial  correlations  between  16x16  pixels  correlation 
windows  in  a  first  frame  and  32  x  32  pixel  search  window  in  a  second  image.  The  two  frames  are 
consecutive,  taken  at  a  rate  of  60  Hz.  Velocities  are  determined  on  nodes  spaces  8  pixels  apart  in  the  x 
and  y  direction.  Figure  12,  shows  an  example  of  the  PIV,  where  a  breaker  is  clearly  visible. 
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Figure  12-  example  of  the  PIV  derived  velocity  field  for  two  frames  3/20s  apart  during  run  1. 

The  OF  algorithm  used  is  based  on  the  Lukas-Kanade  (LK)  method  that  assumes  a  constant  flow  field 
throughout  a  burst  of  images  and  approximates  the  displacement  from  the  changed  in  image  intensity. 
The  partial  spatial  derivatives  of  the  differential  algorithm  are  calculated  with  the  Fourier  Transform  of 
the  images  and  a  flow  vector  is  obtained  for  every  pixel.  Figure  13.  shows  an  example  of  the  OF  for 
the  same  two  frames  shown  above. 
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Figure  13-  Figure  12-  example  of  the  OFderived  velocity  field  for  two  frames  3/20s  apart 

during  run  1. 

The  advective  surface  approach  is  based  on  Dugan  and  Piotowski  (2012)  who  showed  how  to 
determine  the  surface  flow  magnitude  and  direction  by  fitting  the  2D  planar  surface  which  arises  from 
advective  variance  detectable  in  3D  spectra  of  airborne  visible  imagery.  Computing  3D  spectra  of  the 
first  3000  frames  of  each  run,  we  clearly  see  the  advective  signal  as  depicted  in  Figure  15b.  For  less 
than  3000  frames,  the  advective  signal  is  not  usually  as  clearly  visible.  We  perform  a  linear  leat  square 
fit  of  the  advective  surface  in  wavenumber  frequency  slices  of  the  3D  spectra  at  various  angles  relative 
to  the  image.  The  slope  of  the  linear  fit  is  the  magnitude  of  the  advection  at  that  angle.  Fitting  a 
sinusoidal  to  the  obtained  magnitudes  as  a  function  of  angle,  as  illustrated  in  Figure  15b,  we  determine 
the  magnitude  and  direction  of  the  surface  flow  as  the  maximum  of  the  fit  and  the  corresponding  angle. 
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Figure  15-  left:  slices  at  different  angles  through  the  3D  spectra  of  run  12  clearly  displaying  and  advective 
surface;  right:  sinusoidal  fitted  to  the  slopes  of  the  advective  surface. 


Figure  16  shows  the  magnitude  of  the  mean  flow  over  3000  frames  for  all  runs  obtained  by  the  OF 
against  that  obtained  from  the  PIV  and  SAS  method.  The  correlation  coefficient  is  R=0.90  for  PIV  vs. 
OF  magnitudes.  For  mean  flows  of  under  40  pixel/s  the  OF  and  PIV  magnitudes  are  almost  on  the  1:1 
line,  however,  for  stronger  flows  the  PIV  gives  surface  current  magnitudes  up  to  60  pixels/sec  higher 
than  the  OF.  The  advective  surface  method  gives  higher  velocities  than  both  the  PIV  and  the  OF.  The 
correlation  coefficient  is  R=  0.96  between  the  advective  surface  method  and  the  PIV  method  and  R  = 
0.86  between  the  advective  surface  method  and  the  OF  method. 


Figure  16-  scatter  plots  of  the  run  mean  velocity  magnitudes  over  3000 frames  derived  from  the  PIV  method 
vs.  the  OF  method,  PIV  vs.  SAS  and  OF  vs.  VI. V.  In  red  the  1:1  line. 
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Comparing  the  magnitudes  of  the  velocities  derived  from  the  Skin  temperature  with  the  3  different 
methods  to  those  measured  by  the  ADV,  we  see  good  agreemement  between  the  measured  and  the  IR 
derived  velocities;  the  latter  being  slightly  weaker  than  the  former  (c.f.  Figures  17  and  18).  The 
correlation  between  the  derived  and  measured  velocity  magitudes  are  high:  R  =  0.88  for  PIV,  R  =  0.80 
for  OF  and  R  =  0.92  for  SAS. 
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Figure  1 7.  Time  seriries  of  the  flow  magnitude  measured  by  the  ADV  11m  above  the  river  floor.  The 
coloured  stars  represent  the  run  mean  flow  magnitudes  obtained  by  the  3  methods:  PIV, 

OF  and  SAS. 
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Figure  18-  scatter  plots  of  the  run  mean  velocity  magnitude  over  ~1  minute  derived  from  the  PIV 
method  vs.  measured  ADV  velocity  magnitude,  OF  vs.  ADV  and  SAS  vs.  ADV.  In  red  the  1:1  line. 


Filtering  of  Reflection  in  IR  imagery 

In  order  to  remove  the  reflection  seen  in  certain  IR  images,  our  ongoing  efforts  also  evaluate  different 
filtering  techniques.  As  mentioned  above,  when  reflectance  is  visible,  one  can  detect  underlying  skin 
temperature  patterns  which  are  advected  by  the  flow  and  an  overlaying  “film”  of  reflectance  which  is 
not  always  moving  in  the  same  direction  as  the  flow.  This  incite  us  to  use  a  filtering  approach  in  which 
only  the  advective  signal  seen  in  the  3DFFT  is  kept  and  filter  out  all  other  signals  to  reconstruct  an 
image  where  only  the  thermal  structures  and  no  reflectance  are  present. 
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IMPACT/APPLICATIONS 


Although  in  this  field  campaign  the  IR  remote  sensing  was  performed  from  a  ship,  the  analysis  and 
results  obtained  in  this  study  should  be  easily  adaptable  to  imagery  taken  from  other  platforms  such  as 
aircrafts,  manned  and  unmanned,  as  well  as  fixed  platforms.  The  empirical  relationships  will  allow 
inferring  subsurface  flow  characteristics  via  non-intrusive  monitoring  which  should  permit  monitoring 
over  larger,  not  necessarily  easily  accessible  areas. 
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